Web Survey Bibliography
This paper presents experience and evidence, from international sources, of the effects on survey quality of the use of mixed modes in data collection, where the web is used as one of the modes. It is recognised that this is an area which is changing fast as the spread of new technologies assist in widening the population who have access and familiarity with using the web. Surveys found to have used mixed modes (including web) were classified around the conventional schema in the literature; according to whether they used concurrent or sequential approaches in their mixed modes and according to whether they were longitudinal or cross-sectional data collections. In addition, surveys are divided according to whether they attempted to survey general populations or sub populations. Existing longitudinal data collection is of particular interest, and especially where data collection modes have changed at some point into the tracking of individuals. Relatively few longitudinal surveys were identified that had attempted to use the web in data collection and no analyses of the consequence of the mode of response on subsequent wave attrition were found. Many of the examples found focused on sub populations of students and young people, who might call the web-savvy populations. This review showed that experience and familiarity with carrying out mixed mode surveys that include the web have grown considerably over the first decade of the 21st century. For experience of surveying general populations, one needs to look to Scandinavian countries, especially the Netherlands. These countries have also been ahead of most others in their prevalence of households with access to the internet. The review of the literature on survey quality effects of mixed modes shows that use of sequential mixed modes, using the web first, followed by more expensive modes, can achieve response rates on a par with good response rates from high quality single mode studies. The different modes recruit samples with different characteristics. However, such approaches, in combining responses from different modes can also gain coverage of the general population that improves on single mode studies. The evidence from experiments also points out how to get the highest web responses at the first stage of a sequential mixed mode data collection series. This is by failing to mention that there are other mode options for the response. However, measurement errors, namely nonresponse errors and mode effects, are likely to be evident in the data collected. These mode effects are still being charted, and are seen to vary according to the type of question, the type of response codes and even the particular topic content; in some cases the mode effects are relatively minor and in other cases substantial. There is also a problem of confounding which is often present with non-response measurement errors or time effects for longitudinal data. There are well documented generalisations about the social desirability consequences and satisficing under different modes. Other research work is continuing to try and identify how to devise questions, by type, that will minimise mode effects. This involves painstaking attention often to the detail of individual questions. Most researchers think the unimode approach to mixed mode question construction is likely to dominate for some time yet, and UK survey fieldwork organisations also tend to adopt this approach.
NCRM Homepage (abstract) / (full text)
Web survey bibliography - Reports, seminars (231)
- Understanding Society Innovation Panel Wave 4: Results from Methodological Experiments; 2012; Burton, J., Budd, S., Kaminska, O., Uhrig, S. C. N., Brown, M., Calderwood, L.
- The Propensity of Older Respondents to Participate in a General Purpose Survey; 2012; Lynn, P.
- Mode-Switch Protocols: How a Seemingly Small Design Difference can affect Attrition Rates and Attrition...; 2012; Lynn, P.
- The Confirmit Annual Market Research Software Survey 2011; 2012; Macer, T., Wilson, S.
- Marktforschung mit dem iPad-Panel von Axel Springer Media Impact; 2012
- The Impact of Visual Design in Survey Cover Letters on Response and Web Take-Up Rates; 2012; Mockovak, W.
- Inventory of published research: Response burden measurement and reduction in official business statistics...; 2011; Giesen, D. & Snijkers, G. (Eds.), Bavdaz, M., Bergstrom, Y., Gravem, D. F., Haraldsen, G., Hedlin, D...
- Less questions, more data: Revitalizing the european currency in single source affluent audience measurement...; 2011; Hartman, H.
- Linking website exposure data to survey data: A single-source solution; 2011; Krahn, J., Landi, J., Melton, E.
- Inference in surveys with sequential mixed-mode data collection; 2011; Buelens, B., van der Brakel, J.
- Search and email still top the list of most popular online activities; 2011; Purcell, K.
- On the experience and evidence about mixing modes of data collection in large-scale surveys where the...; 2011; Dex, S., Gumy, J.
- What is Probit; 2011
- User agent; 2011
- Unpublisihed internal Google report on break off rates by device type; 2011; Callegaro, M.
- The impact of cookie deletion on site-server and ad-server metrics in Australia. An empirical comScore...; 2011
- State of mobile measurement; 2011; Gluck, M.
- SDSC Announces scalable, high-performance data storage cloud; 2011
- New Esomar survey on use of cookies and tracking technologies; 2011
- Mobile, webmail, desktops: Where are we viewing email now?; 2011
- Just published: Forrester Wave™ of enterprise feedback management satisfaction and loyalty solutions...; 2011; McInnes, A.
- ISER working paper 2011-31. Is it a good idea to optimise question format for mode of data collection...; 2011; Nicolaas, G., Campanelli, P., Hope, S., Jaeckle, A., Lynn, P.
- Internet access quarterly update 2011 Q1; 2011
- Households with Computers, Telephone Subscriptions, and Internet Access, Selected Years, 1997 - 2010; 2011
- GRE® program announces big benefits and big savings for GRE® test takers worldwide; 2011
- Google and Kantar develop measurement panel; 2011
- Global market research 2011; 2011
- Eurobarometer Special surveys: EB75.1 E-Communications Household Survey. Special Eurobarometer 362; 2011
- Causes of survey incompletes: Why panelists say they abandon surveys; 2011; Henning, J.
- Beyond data stability: Rising above quality concerns; 2011
- Background - QSOAP; 2011
- Standard Definitions: Final Dispositions of Case Codes and Outcome Rates for Surveys 2011; 2011
- Web Survey Methodology: Interface Design, Sampling and Statistical Inference; 2011; Couper, M. P.
- Effect of interview modes on measurement of identity; 2011; Nandi, A., Platt, L.
- Maintaining Cross-Sectional Representativeness in a Longitudinal General Population Survey ; 2011; Lynn, P.
- Understanding Society Innovation Panel Wave 3: Results from Methodological Experiments; 2011; Burton, J., Budd, S., Gilbert, E., Jaeckle, A., McFall, S., Uhrig, S. C. N.
- The Effect of a Mixed Mode Wave on Subsequent Attrition in a Panel Survey: Evidence from the Understanding...; 2011; Lynn, P.
- Is it a good idea to optimise question format for mode of data collection? Results from a mixed modes...; 2011; Nicolaas, G., Campanelli, P., Hope, S., Lynn, P., Nandi, A.
- In the Face of Declining Budgets: The Student Experience at Washington State University ; 2011; Allen, T., Dillman, D. A., Garza, B., Millar, M. M.
- Framing Effects and Expected Social Security Claiming Behavior; 2011; Brown, Je., Kapteyn, A., Mitchell, O. S.
- Framing Effects and Expected Social Security Claiming Behavior; 2011; Brown, Je., Kapteyn, A., Mitchell, O. S.
- Computer Assisted Interview Testing Tool (CTT) - a review of new features and how the tool has improved...; 2010; Stark, R., Gatward, R.
- Address-based Sampling Nets Success for KnowledgePanel® Recruitment and Sample Representation; 2010; DiSogra, C.
- Mixed-Method Approaches to Social Network Analysis; 2010; Edwards, G.
- Measuring Intent to Participate and Participation in the 2010 Census and Their Correlates and Trends...; 2010; Pasek, J., Krosnick, J. A.
- What it takes to be a top 100 website; 2010
- The psychology or survey response. An ASA webinar; 2010; Tourangeau, R.
- Site-intercpet survey best practices; 2010; Henning, J.
- Real ID. State of The Art Representative and Repeatable Online Samples. Behaviorally Profiled Respondents...; 2010; Gittelman, S. H., Trimarchi, E.
- Overview of data collection methodology; 2010